Iclr 2018 F Ew - S Hot L Earning with G Raph N Eural N Et - Works
نویسنده
چکیده
We propose to study the problem of few-shot learning with the prism of inference on a partially observed graphical model, constructed from a collection of input images whose label can be either observed or not. By assimilating generic message-passing inference algorithms with their neural-network counterparts, we define a graph neural network architecture that generalizes several of the recently proposed few-shot learning models. Besides providing improved numerical performance, our framework is easily extended to variants of few-shot learning, such as semi-supervised or active learning, demonstrating the ability of graph-based models to operate well on ‘relational’ tasks.
منابع مشابه
Iclr 2018 C Onvolutional Vs . R Ecurrent N Eural N Et - Works for a Udio S Ource S Eparation
We propose a convolutional neural network as an alternative to recurrent neural networks for separating out individual speakers in a sound mixture. Our results achieve state-of-the-art results with an order of magnitude fewer parameters. We also characterize the robustness of both models to generalize to three different testing conditions including a novel dataset. We create a new dataset RealT...
متن کاملS Emi - S Upervised F Ew - S Hot L Earning with Maml
We present preliminary results on extending Model-Agnostic Meta-Learning (MAML) (Finn et al., 2017a) to fast adaptation to new classification tasks in the presence of unlabeled data. Using synthetic data, we show that MAML can adapt to new tasks without any labeled examples (unsupervised adaptation) when the new task has the same output space (classes) as the training tasks do. We further exten...
متن کاملPublished as a conference paper at ICLR 2018 S IMULATING A CTION D YNAMICS WITH N EURAL P ROCESS N ETWORKS
Understanding procedural language requires anticipating the causal effects of actions, even when they are not explicitly stated. In this work, we introduce Neural Process Networks to understand procedural text through (neural) simulation of action dynamics. Our model complements existing memory architectures with dynamic entity tracking by explicitly modeling actions as state transformers. The ...
متن کاملIclr 2018 a Ttention - B Ased G Uided S Tructured S Parsity of D Eep N Eural N Etworks
Network pruning is aimed at imposing sparsity in a neural network architecture by increasing the portion of zero-valued weights for reducing its size regarding energy-efficiency consideration and increasing evaluation speed. In most of the conducted research efforts, the sparsity is enforced for network pruning without any attention to the internal network characteristics such as unbalanced out...
متن کاملA Genetic Fuzzy Neural Network for Pattern Recognition
In, th,is paper, a gen,etic fu,zzy n,eu,ro,l n,etwork f o r pattern, recognition, is proposed by applyin,g genwtic algorith,ms to th,e Kuian,-Cai f v z z y n,eural network. A genekic-guided self-organizinq learn,in,g a1gorith.m i s CO,pable of redncinuj th,e nmm'ber of f m z y neurons an,d in,creasinq recognxikion rates f o r th,e fixed n,um,ber of outpu,t neurons. Th.e simulataon,s h,ave indic...
متن کامل